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Abstract. We describe some basic results for Quantum Stochastic Processes 
and present some new results about a certain class of processes which are 
associated to Quantum Iterated Function Systems (QIFS). We discuss ques- 
tions related to the Markov property and we present a definition of entropy 
which is induced by a QIFS. This definition is a natural generalization of the 
Shannon-Kolmogorov entropy from Ergodic Theory. 
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1. Introduction 

We review and discuss some main properties of Quantum Stochastic Processes 
(see [6] [18] [20]) and present some new results about a certain class of processes 
which are associated to a Quantum Iterated Function System (QIFS). The concept 
of QIFS was introduced in the work [14j . and it is a natural object in Quantum 
Information Theory. 

We also present a definition of entropy which is suitable for the QIFS. This 
definition is a natural generalization of the Shannon-Kolmogorov entropy of Ergodic 
Theory. We describe a parallel between the classical Kolmogorov entropy and the 
one we present here, which is different from the one seen in [TJ. 

The present definition of entropy is obtained by adapting the reasoning described 
in [5] , [T^] and Q3] to the setting we present in this work. The main idea is to define 
this concept via the Ruelle operator and to avoid the use of partitions. Using 
this definition one can consider maximal pressure density states. This formulation 
can be seen as a mini-max problem (see [5] [12] [13]). In [1] it is described some 
applications of the pressure problem. 

Section [2] introduces basic notations and section [3] describes QSPs following [15] ; 
section [4] and [5] describes Quantum Iterated Function Systems, following [14] . Sec- 
tion [5] is a brief digression on the Chapman-Kolmogorov equation and probability 
amplitudes. Section [7] defines probabilities measures and quantum stochastic pro- 
cesses induced by QIFS. Section [5] gives a definition of entropy induced by a QIFS 
and we make a few remarks on the variational problem of pressure. 
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Our work is inspired by results presented in |14] and [19] . We would like to 
thank these authors for supplying us with the corresponding references. Some 
other references related to the topic described here are [I] [2] [3] ID [IS]- 



This work is part of the thesis dissertation of C. F. Lardizabal in Prog. Pos-Grad. 
Mat. UFRGS (Brazil) [10]. 



We recall some basic notation which is used in Quantum Computing. For a 
comprehensive introduction to the subject, see [16]. Let Hn be a Hilbert space of 
finite dimension N. If a quantum system is in a certain known state \ip) £ Hn, 
we say that the system is in a pure state. Otherwise the system is in a mixed 
state. Each system contains certain pure states, which are fixed when we define our 
problem. Also, such states are normalized, so we have (ip\if>) = 1. For any phase a, 
we identify the elements \ip') = e la \ip) and so we get the space of pure states, 
denoted by Vn- Topologically, it is the complex projective space CP^ -1 with the 
Fubini-Study metric, given by Dpsd^), \i>)) '■= arccos|(0|V>)l- 

A qubit is a unit vector in a complex vector space of dimension 2 



where 0, (j), 7 are real numbers. As we are in projective space, the factor e %1 can be 
ignored, so we can write 



The numbers 9 and (f> define a point on the unit sphere, the Bloch sphere, which 
gives us an easy way to visualize the state of a qubit. 

Denote by p* the adjoint of p : Hn —> Hn- We say that p : Hn —> Hn is 
hermitian if p = p* . We say that a hcrmitian operator P : Hn — > Hn is positive, 
denoting such fact by P > 0, if (Pv, v) > 0, Vt> £ Hn- 

Definition 1. A density operator (or density matrix) is an operator p acting 
on Hn, with p = p* , p > and trp = 1. Denote by Mn the space of density 
operators. 

If £ Hn denote the associated projection by We denote by 



the canonical orthonormal basis for Hn- A density operator p can always be written 



2. Notations 




|0> =e^( COS -|0)+e^n-|l», 



= cos-\0) + e i4 'sin-\l) 



{\Q),...,\N-l)}, 



as 



k 



(1) 




i=l 



QUANTUM STOCHASTIC PROCESSES, QUANTUM IFS AND ENTROPY 3 

where the pi are positive numbers with X^iP* = 1> an< ^ * = 1, 2, ...iV — 1, is an 
orthonormal basis. 

A pure state is such that its associated density operator satisfies tr(p 2 ) = 1; if 
a state is mixed, we have tr(p 2 ) < 1. Also an operator is a density operator if and 
only if its trace equals 1 and if it is positive. 

3. A DESCRIPTION OF QUANTUM STOCHASTIC PROCESS 

In this section the definitions and examples were taken from [T5], where it is 
presented a definition of quantum stochastic process. We briefly describe some of 
the results obtained in that work. 

Definition 2. A state space is a pair (V,K), where 

(1) V is a real Banach space with norm \\ ■ \\. 

(2) K is a closed cone in V . 

(3) Ifu,v£ K then \\u\\ + \\v\\ = \\u + v\\ 

(4) If u G V e e > then there are ui,U2 G K such that u = U\ — «2 and 

hill + IMI < IMI + e - 

Definition 3. // (V, K) is a state space then there is a unique positive linear func- 
tional t : V — > M such that t(u) — \\u\\ if u G K , and t(u) < ||tt|| if u G V . We say 
that u G K is a state if t{u) = 1. 

Example 1. Let % be a finite dimensional Hilbert space and let V be the space 
of hermitian operators in %. Let K be the set of positive operators in V . In this 
case we have t{B) = tr{B) for all B operator in V . 



Definition 4. A phase space is a measurable space (f2, E) where fi represents the 
set of all possible results for a measurement and E is a a-algebra of subsets of O. 

Let V* be the dual space of V. We introduce a partial order on V* by defining 
<fi > ip if 4>(u) > ip(u), for all u G K. 

Definition 5. An effect is a mapping <fi G V* such that < <fr < r. We denote 
the space of effects by £ C V* . 

Definition 6. We say that x : T, — > £ is an observable if x is a measure taking 
values on the space of effects, such that x(n) = t. 

If E G E, u G K and t(u) = 1 then x(E)u can be interpreted as the proba- 
bility that the result of the measurement of the physical quantity represented by 
x, prepared in the state u, belongs to the set E. In the case of quantum mechan- 
ics in Hilbert space, effects can be identified with bounded operators A such that 
< A < 1 by the formula 4>a{W) = tr(AW). 

Definition 7. An operation is a positive linear operator T : V — ¥ V satisfying 
< t(Tu) < t(u) for all u € K. The space of operations will be denoted by O. 
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Definition 8. An operator valued measure, or an OVM on a phase space is 
a map X : E — > O such that if {E n } is a sequence of disjoint sets in E, then 
l(UE n ) = £2T(P„). 



Definition 9. Let X : E O be an OVM, then we say that I is an instrument 

if 

(2) t(T(Q)u) — r(it),Vtt G V. 

We interpret such notion in the following way. Let I be an instrument, E G S, 
u G K . If u is the state of the system before the measurement and if I determines 
a value in E then the resulting state is given by 

1 J t(I(E)u) 

Note that for each instrument I, there is a unique observable xi : E — > £ such 
that t(I(E)u) = Xi(E)u, E G E, u G if . Also, it is possible that two instruments 
correspond to the same observable [TS] . 

The following are examples of instruments: 



Example 2. Let H be a Hilbert space, and let J-(H) be the space of hermitian 
operators A in % such that 

^(e fe , Ae fc ) < oo 

fcSN 

and have the same value in any orthonormal base {efejfegN for H. Let 57 — 
{1, . . . , N}, or Q = N, let {Pijien be a family of orthogonal projections such that 
J2 Z Pi = I- Define 

1 : E -> O 
: E — > £ 

as 

(4) 2r(P)p:=£p i/9 p, 

(5) x^P := $>(P<p), 
for all PC Q and p£ F{H). 



Example 3. Let H be a Hilbert space, a topological space, E a er-algebra for 
f2 and to a measure on (O, E). Let {P a } a en be a family of projections on %, such 
that the mapping a — > P a is strongly continuous and Jq P a dm(a) = I. Then define 

I : E -> O 



: E — > £ 
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as 

(6) Z(E)p:= [ P aP P a dm(a) 

J E 

(7) xi{E)p:= [ T (P a p)dm(a), 

J E 

for all E C fl c p e F{U). 



Example 4. Let X be a locally compact Hausdorff space, V the space of the 
countably additive functions on the Borel er-algebra B{X) for X endowed with the 
norm of total variation. Let K be the set of nonnegative measures on V. Let 
(fi,E) = (X,B(X)). Then 

(8) l(E)p(A)=p(AnE), 

for p E V , A, E E H is an instrument, called the sharp classical measurement 

and the corresponding observable is 

(9) x x (E)p = p(E) 



Definition 10. Following [IS], a Quantum Stochastic Process, QSP, is an 
arbitrary family of instruments {T t } t( zj. Let J = Z or J = R for discrete or 
continuous time, respectively. 

The finite dimensional distributions of the process are measures //" t 
defined in (fi™, Z?(fi n )) as being the natural extensions of the functions given by 

(10) f4 ,..., tn -A E ° x ' ' ' x E n-i) = r{{Xt n _, (E n -i)oI tn _ 2 (E n - 2 ) o • ■■ol to (E ))u) 

where n £ N, < • ■ ■ < tn-i> G J, m e V and So, . . . , S n _i € E. The meaning of 
such expression is the following: /x" tn _ 1 (i?o x • ■ ■ x E n -i) is the joint probability 
that successive measurements of the system by the instruments Iq, . . . ,I n -i in the 
moments to, ... , <„_i produce values in Eq, . . . , -E Tl _i, when the pre-measurement 
state is u. 

A probability transition is a function P : Jl x S -> 1 such that P(-,E) is 
measurable for all E € X and P(x, •) is a probability measure for all x £ f2. 

Definition 11. PFe say i/iai a (J>S-P is Markov if there exists a family of probability 
transitions {P s j}s<t such that 

Vt ,-,t n -i( E a x ••• x E n-i) 

(11) = / / "•/ p t n -ut n (yn-i,dy n ) ■■ -Pt , tl (yo,dyi)p% (dy ) 

J Eq J E\ ** 

/or all t < ■ ■ ■ < t n , ti E J , u E V, E , . . . , E n G E. ^4 Markov QSP is homoge- 
neous £/ i/ie probability transitions P s j depend only on the difference t — s. 
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Remark In contrast with the classic theory of stochastic processes, the probabil- 
ity transitions of a Markov QSP do not satisfy in general the Chapman-Kolmogorov 
equation. 



Definition 12. Let X be an instrument. Assume that between the measurements 
the system evolves and its evolution is described by a group {T t } te j of isometric 
automorphisms ofV. Then define the QSP {T t }tej, where 

(12) l t (E)=T t - 1 ol(E)oT t 

is called a transformed instrument. For simplicity, we can choose J = Z so 
T n — T n and we denote such process by C(T, T). 

Now we show an example of a Markov QSP. 

Example 5. Let I be the instrument given in example [4] and let : X — > X be a 
measurable map. Then O generates an automorphism Tq : V — > V by 

(13) T e (n)(A) = n(Q- 1 (A)), ^eV,AeB(X) 

Then we can show that C(Tq,1) is a homogeneous Markov QSP and its transition 
probability is given by 

(14) P(x,E) = X E (Qx), xeX, EeB(X) 



4. Quantum IFS 

This section follows [14]. We begin with a few definitions. 

Definition 13. Let Gi : A4n —> -Mn, Pi '■ -Mn — > [0, 1], i = 1, . . . , k and such that 
J2iPi(p) = 1- We call 

(15) J"jv = {M.N,Gi,Pi : i = l,...,k} 
a Quantum Iterated Function System (QIFS). 

Definition 14. A QIFS is homogeneous if pi and Gipi are affine mappings, 
i = 1, . . . , k. 

Suppose that the QIFS considered is such that there are V$ and Wi linear maps, 
i=l,...,k, with Ylt=i W?Wi = I such that 

(16) Giip) = - 

tr{VipV*) 

and 

(17) pi(p) = tr{W lP W*) 

Then we have that a QIFS is homogeneous if Vi=Wi, i — 1, . . . , k. Now we can 
define a Markov operator P : M{Mn) -> M(Mn), 

k 



r^ x JG-\B) 
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where M{Mn) denotes the space of probability measure over Mn- We also define 
K : Mn ^ Mn, 

k 

Hp) ==I>(p)Gi(p) 

i=l 

If the QIFS considered is homogeneous then 
(18) A(p) = J2V iP V* 

i 

We say that p e Mn is the integral of a mapping / : Mn —> Mn, denoted by 




if 

l{p) = / lofd/M, 

J Mn 

for all I <E M* N . 

Theorem 1. A mixed state po is A-invariant, if and only if, 
(19) Po= pdp(p), 

J Mn 

for some P -invariant measure p. 
For the proof, see [H], [T5] . 

In order to define hyperbolic QIFS, we have to specify a distance on the space 
of mixed states. The following are a few possibilities: 

D 1 ( Pl ,p 2 ) = y/tr[(p 1 - P2 ) 2 ] 
D 2 (pi,P2) = try/ (pi - p 2 ) 2 

D 3 (pi, P 2) = ^2{l -tr[{p\ /2 p 2P \ ,2 y/ 2 ]} 

Such metrics generate the same topology on Mn- Considering the space of mixed 
states with one of those metrics we can make the following definition. 

Definition 15. We say a QIFS is hyperbolic if the quantum maps Gi are con- 
tractions with respect to one of the distances on Mn arid if the maps pi are Holder- 
continuous and positive. 

Proposition 1. [14j j!9) If a QIFS 115\) is homogeneous and hyperbolic then the 
associated Markov operator admits a unique invariant measure p. Such invariant 
measure determines a unique A-invariant state p € Mn, given by 111 9$ . 



s 



A. BARAVIERA, C. F. LARDIZABAL, A. O. LOPES, AND M. TERRA CUNHA 



5. Examples of QIFS 

Example 6. ft = M N , k = 2, Pl = p 2 = 1/2, Gi{p) = U 1P U?, G 2 {p) = U 2 pU^ 
The normalized identity matrix = I/N is A- invariant, for any choice of unitary 
Ui and U 2 . Note that we can write 

p* = pdp{p) 

J Mn 

where the measure p, uniformly distributed over Vn, is P-invariant. 



Example 7. Let ft = M N , k = 2, Pl = p 2 = 1/2, d(p) = {p + 2 Pl )/3, G 2 (p) = 
(p + 2p 2 )/3, where we choose the projectors p\ — |1)(1| and p 2 = |2)(2| so that they 
are orthogonal. Since G\ and G 2 are contractions with Lipschitz constant equal to 
1/3, this QIFS is hyperbolic and so there is a unique invariant measure. 



Recall that a mapping A is completely positive (CP), if A ® I is positive 
for any extension of the original Hilbert space Hn — > Hn & He- We know that 
every trace preserving CP map can be represented (in a nonunique way) in the 
Stincspring-Kraus form 

k k 
j=l 3=1 

where the Vj are linear operators. Besides, if Ylj=i ^3'^j* = ? th cn A(7/7V) = I/N 
and A will be called unital. This is the case if each of the Vj is normal, that is, 
if VjV* — V*Vj. Note that by writing Gi(p) — U l pU* , we have that example [5] is 
contained in this class of QIFS. We call such QIFS unitary. For a unitary QIFS 
we have that /?* is an invariant state for Kjj and also that S Pt is invariant for the 
Markov operator Pu induced by this QIFS. 

Definition 16. We say that unitary matrices of same dimension are common 
block diagonal if they are block diagonal in the same base and with the same 
blocks. 

The proof of the following lemma is presented in [14] . 

Proposition 2. Assume that pi, i = 1, ...,k are strictly positive. The the maxi- 
mally mixed state p* is the unique invariant state for the operator Au if and only 
if the unitary operators Ui, i = 1, . . . , k are not common block diagonal. 

Example 8. Let Q = V 2 . U± = I, U 2 — a±, U 3 = a 2 , U4 — cr 3 , pi = 1 — p, 
P2 = P3 = P4 — p/3 > 0, where 01,02! 03 are the Pauli matrices. Since such 
matrices are not common block diagonal the maximally mixed state p„ is the unique 
invariant state for the mapping below, called a quantum depolarizing channel [14] : 

^u(p) = ^PiU l pU* = (l-p)p+ -(oipoi + a 2 pa 2 + cr 3 pa 3 ). 
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Example 9. Let ft = V2, Pi = 1 — P, P2 = P, 

Ui = exp(-iH T/h), 

U 2 = exp(- l -(H T + J V(t)dt)) 

where V(t) = V(t + T). The maximally mixed state = 1/2 is an invariant state 
for the operator Ay corresponding to this QIFS. For a generic perturbation V, 
matrices U\ and U 2 are not common block diagonal so p* is the unique invariant 
state for Ajj- 



6. On certain probability and amplitude calculations 

We begin with a brief digression on the Chapman-Kolmogorov equation. Let 
X = {X n } be a sequence of measurable functions. Suppose that 

P(X n+1 = j\X n = i) = P{X 1 = j\X = i) 

for all n,i,j. Suppose that X takes values on a finite set S. Define the matrix 
P = (pij) of order \S\, with entries 

Pij = P(X n+1 = j\X n = i) 

Define the matrix of n transitions P n = (pij(nj), where 

Pij(n) = P(X m+n = j\X m = i) 

Also suppose that it is a Markov chain, that is 
(20) 

P(X n = x n \X = xo,Xi = xi, . . .,X„_i = x n -i) = P(X n = x n \X n -i = x n -i) 

for all n > 1, and xo, ■ ■ ■ , x n € S. 

By using the fact that for any events A\, A2, A3, we have 

(21) P{A 1 n A 2 \A 3 ) = P(A!\A 2 n A 3 )P(A 2 \A 3 ) 
we can write 

Pij (m + n) = P(X m+n = j\X =i) = ^2 P{X m+n = j, X m = k\X = i) 

k 

(22) = P(Xm+n = j\X m = k)P(X m = k\X = i) 

k 

So 

(23) p^ (m + n) =Y Pik {m)p kj (n) 

k 

which is the Chapman-Kolmogorov equation. We are interested in studying quan- 
tum stochastic processes and in obtaining an adequate definition to what we will 
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call a Markov quantum stochastic process. First we recall that in the previous sec- 
tion we have presented a description |18j of Markov QSP in which the Chapman- 
Kolmogorov do not hold in general. This fact can be seen as the general rule for 
quantum processes (but see [8] for different settings). 

In algebraic terms, we can argue that the deduction of (f23f above is not valid 
for quantum processes because of equation (|21l) . Since we have to take in consid- 
eration the interference between measurements, the problem of understanding how 
probability measures work in a quantum setting is a basic question. In quantum 
mechanics we could in principle consider a probability space (f2, A, fi) such as in 
classic measure theory. However, we have that A is a er-algebra and /i is a measure 
on A only when we are restricted to a single measurement. When we perform sev- 
eral measurements interference effects occur and so we are no longer considering a 
problem on classic probability [7] . Results of more general nature are presented in 
i- 

We can think that interference occurs because, in contrast to classic probability 
measures, which can be quite arbitrary, quantum probability measures are obtained 
in a very specific way. In quantum mechanics we have an amplitude function 
a : SI — s- C, and if B g A, we define the amplitude of B as 

(24) A(B) = J2 «M 

uieB 

and we define the probability that B occurs as 

(25) »(B) = \A(B)\ 2 

Let us describe a few more details on this point. For more on the subject, see for 
instance [7]. Let fl be a nonempty set and let a : £1 —> C. We say that ui € £1 is a 
sample point and the map a is a probability amplitude, and (fi, /) is called a 
quantum probability space. A set A C £1 is summable if XLesi l a ( w )| 2 < 00 
and we denote the collection of summable sets by So. Now define A : So — > C as 
A(9) = and 

(26) MB) := Y, «M 

We say that A(B) is the amplitude of B. Now define 

if A(B 2 ) 7^ and equal to zero, otherwise. In the case that A(B 2 ) ^ 0, we have that 
A(-\B 2 ) is a complex measure on P(f2), with A(fl\B 2 ) = 1. We say that A(Bi\B 2 ) is 
the conditional amplitude of Bi, given B 2 . Note that A(B) = does not imply 
A(B n C) = 0. Because of that, formulas of the kind A(B n G) = A{B)A{C\B) 
might not be true when A(B) = 0. However, when the conditioning sets have a 
nonzero amplitude, we have the formula 

(28) A{B X n • • • n B n ) = A{B 1 )A{B 2 \B l )A{B^\B 1 n B 2 ) ■ ■ ■ A{B n \B l n • • • n B n _i) 
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which is the amplitude counterpart for equation (|2ip . Define the matrix A — (ay), 
where ay = A{X n +i = j\X n = i). Now suppose that the chain {X n }neN is 
quantum Markov, that is, 
(29) 

A(X n = x n \X = xq,X-l = xi, . . . , X n -i = x n -i) = A(X n = x n \X n -i = x n -i) 

for all n > 1, x , . . . ,x n £ S. So in a way which is similar to what we did for 
probabilities, define the matrix of n transitions A n = (ay(n)), where a,j(n) = 
A(X m+n = j\X m = i) and we get 



(30) 



dy (m + n) = a lfe {m)a k] (n) 



so we have that ^4 m +„ = A m A n and ^4„ = A". 







7. Probability measures induced by QIFS 

In this section we present some new results. Consider a Hilbert space H of 
dimension TV = 2. Let gi, <?2 € K and also 





(31) Vi = 



iPii VP 12 




V 2 = 







/P21 JP22 





' PI 


P2 \ 


)' p = 








V P3 


Pi ) 



We would like to obtain the fixed points for 

C{p) = qxVxpV? + q 2 V 2 pV* 



Then 

(32) 

implies 



qiVipV* + q 2 V 2 pV* = p 



(VPllPl + \fVY2p-i)^fPYl + {\[PVlP 2 + V / P12P4) V / P12 
WpHlPX + V / P22/°3)v / P21 + {\/P2lP2 + VP^Pa)VP22 



Pi 
Pi 



And Q32[) also implies that p 2 = p% = 0, so we rewrite the system as 
qi y/pllpiy/pii + VPi2P4y/P^ = Pi 

q 2 v / P2i~Piv / P2i + Vp^nPiy/Pzz = P<t 



or 
(33) 

(34) 
where 

We also get that 



a Pi + I Pi = Pi 
gpi + hp 4 = p 4 

a = qipu, f = qipi2, g = q 2 p 2 i, h — q 2 p 22 
f 



Pi 



1-a 



Pi 
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1 - h 

Pi = PA 

9 

which is a restriction on the qi, namely 

/ = l-h 
1 - a g 
Therefore the solution of ([551) and is 

But pi + p4 = 1 implies 

/ 91P12 Q \ / 1-92P22 Q 

(35) /9 = ( 91P12-91PH + 1 , | = | 1-92P22+92P21 



() 1-giPii II Q ?2P21 

91P12 — giPll + 1 / \ 1-?2P22+«32P21 



Now assume that 



P = 



P11 P12 
P21 P22 

is column stochastic. Let tt be such that Pit = tt. Such tt is given by 

(36) *=( ^ , l ~ PlX ) 

P12 -Pu + 1 P12 — pit + 1 

Compare (|3"6")l with (|3"5j) . Then fix </i = (72 = 1 se we get that the nonzero entries of 
p are equal to the entries of tt. Such a choice for the qi is unique. In fact, comparing 
the (i,i)-th entry of p with the i-th coordinate of tt, we see that if there exists q\ 
which make p and tt equal (i.e., the diagonal entries of p correspond to the entries 
of 7r) , then 

9iPi2 _ q[Pi2 

q\p\2 - q\p\\ + 1 q\P\2 - q\pw + l ' 

which implies 

qi{q'iPi2 - q'lPn + 1) = q'MiPu - qmi + 1) 
=> - qWiPn + qi = qiq[pi2 - qiq[pu + q\ 

and when we cancel terms we get q\ = q[. In a similar way 

1 ~ <?2P22 _ 1 - g 2 P22 

1 - <72P22 + 92P21 1 - q' 2 P22 + q' 2 P2\ 

implies 

(1 - q 2 p 22 )(l - q' 2 P22 + q' 2 P2l) = (1 - q' 2 P22)(l - q2P22 + q2P2\) 
=> 1 - q' 2 P22 + q' 2 P21 - 92P22 + <72<7 2 P22 - 929 2 P22P21 
= 1 - q 2 P22 + q2P2\ - q' 2 P22 + q2q' 2 P22 - Q2q' 2 P22P21 

Then we get 

Q 2 P21 = 92P21 => q' 2 = 92 

and therefore the choice for qi and q 2 is unique. 
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Consider a homogeneous QIFS T = {M.jsr, Fi,Pi}i=l,...,k, where 

tAp) tr{V iP V*) 

where the Vi are linear with J^i VfVi = I an d Pi(p) — t r (VipVi*)- Then A is written 
as 

A(p) = J2PiFi = Yl V iP V i 

i i 

By simplicity we will assume that the quantum system considered can assume two 
states called 1 and 2. 

We say that the pair ({X n }„ e N, X n : Q — > {1, . . . , k}, is a Quantum Sto- 
chastic Process, QSP (homogeneous case), associated to the QIFS J- whenever p 
is defined as 

(37) p{X x =Xi,...,X n = x n ) := tr(V Xn V Xn _ l ■ ■ ■ V X2 V xlPo VlV* 2 ■ ■ ■ V^V^J 

where po € Mn is any density operator. The operator po is a pre-measurement 
state, that is, we have a quantum system and we prepare po as being its initial state 
(for a similar treatment to a sequence of measurements, see the definition of finite 
dimensional distributions in section 13]). 

So we can define for any r, 

tr(V Xr V Xr _ lP oV* ^V* ) 

(38) p,(X r = x r \X r _i = x r _i) = — — r 

Definition 17. We say that a QSP is Markov if 

(39) (j,(X n = x n \X 1 =xx,.. . ,X„_! = 2i„_x) = p(X n = x n \X n _ 1 = x„_i) 



Remark The condition J2i = I i s enough to show that the measure of a 
partition of cylinder sets equals 1. For instance, for two states 1 and 2, for k = 2 
and writing 

Mu) : = p( x i = h X 2 = j), 

we have 

jtx(TT) + /i(12) + //(21) + M (22) 
= tr(VxV x pV?V?) + tr{V 2 V lP V?V 2 *) + tr{VxV 2 pV 2 V?) + tr(V 2 V 2 pV 2 *V 2 *) 
= tr{V?Vi\V x pV?}) + tr{V 2 *V 2 [V lP Vn) + tr{V?Vi[V 2 pV 2 *)) + tr(V 2 *V 2 [V 2 pV 2 *}) 
= tr({V?Vi + V 2 *V 2 )[VipV?}) + tr({V 1 *V l + V 2 *V 2 )[V 2 pV 2 * 



(40) = tr(VipV?) + tr{V 2P V 2 *) = tr{{V l *V 1 + V 2 *V 2 )p) = 1 

However, we note that there exist examples in which we can show that the measure 
of a partition of cylinder sets equals 1 even if we do not suppose that V*Vi — 
I. This happens, for instance, in the following construction involving stochastic 
matrices. 
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Let us consider the particular case in which the operator po € Mn, given in the 
definition of QSP is a fixed point for A(p) = £? =1 VpV* induced by the QIFS T. 

Suppose that V\ and V 2 are defined by (|3"Tj) . Suppose that the matrix P = ( Pi j) 
is column stochastic and that we have tt such that Ptt — tt. For instance we have 

(41) fi(Xi = 1,X 2 = 2) = tr{V 2 V\poV*V 2 ) = P2i(puPu +P12P22) = P21P11 

because with the choice of V, we made, we have that the nonzero entries of po 
correspond to the entries of tt. So we can interpret Pij as being 

(42) p ij =p J (X 2 =j\X 1 =i) 
In a similar way, 

(43) p{X l = 2,X 2 = 1) = tr(V 1 V 2 p V 2 *V 1 *) = Pl2 p 22 
and 

(44) p(X 1 = 1,X 2 = 2,X 3 = 1) = tr{V x V 2 Vx PQ V^Vl) - P12P21P11 

Remark A simple calculation shows that with the Vi given by (|31|) we have that 
J2i Vi*Vi 7^ I- However, we still have that 

M(lT) + m(12) + M(21) + M(22) = 1 



To prove that the choice (pTTj) reduces to the classic case for any sequence, we 
use the following lemma. 

Lemma 1. Suppose N = 2, k = 2. Then for every m, for Vi given by 131)) and po 
corresponding to the stationary vector tt for P, we have that the product 

(45) V^V^ ■ ■ ■ V XlPo V x \ V x * 2 ■ ■ ■ V x * m 
has the form 












r ) 

V J 


ou 


\ 









(46) 

depending on whether x m — 1 or x rn — 2, respectively 
Proof By induction. If m = 1 then 

(47) VxpoV? = 
and 

(48) V 2Po V 2 * = 



Pupn +P12P22 






P21P11 +P22P22 
Suppose the lemma valid for m, we consider the product 

(49) v Xm+1 v Xm ■ • • v xi pov^ v x * 2 ■ ■ ■ v x * m v x * m+1 

Suppose x rn+ i = 1. Then a simple calculation shows that 
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has only one nonzero entry, namely the (1, l)-th entry. We proceed in a similar way 
for the case that x m +i — 2, that is 





(51) 



V-2 



* 




V? e V 2 



* 



V* 



has only one nonzero entry, namely the (2, 2)-th entry. 
Proposition 3. If we set 



□ 



(52) 
then 



V, = 



/Pll y/Pl2 





Vo = 











/P21 JP22 



(53) (l(Xl = Xi,X 2 = X 2 , . . . ,X n = X n ) = Px n x n -lPxn-lXn-2 ■ ■ ■Px 3 x 2 Px 2 x 1 Px 1 x 1 

where pij denotes the (i,j)-th entry of po, eigenstate for A(p) = VipV* . 

Proof We prove by induction. Suppose n = 1. Then 

p(Xi = 1) = tr(Vip V*) = pnpn + P12P22 = Pn 

p(Xi = 2) = tr(V 2 poV 2 *) = P21P11 +P22P22 = P22 
For the sake of clarity we also show the case n = 2. We have, after some routine 
calculations that 



(54) 


p(Xi 


= i,x 2 


= 1) 


= tr(V 1 V lPo V 1 *V 1 *) 


= P11P11 


(55) 


p(Xi 


= i,x 2 


= 2) 


= tr(V 2 V lPQ V*V*) 


= P21P11 


(56) 


p(Xi 


= 2,X 2 


= 1) 


= tr(V 1 V 2Po V 2 *V 1 *) 


= P12P22 


(57) 


p(Xi 


= 2.X 2 


= 2) 


= tr(V 2 V 2PQ V 2 *V 2 *) 


= P22P22 



Now suppose the lemma holds for n, let us prove it for n + 1. 

First suppose x n+ i = 1. Then 

/x(Xi =Xi,...,X n = x n ,X n+ i = 1) 

(58) = tr{VtV Xn ■ ■ ■ Vx 2 V Xl p V x \v; 2 ' ' ' V^V^V?) 

Using lemma [T] we have two cases. If x n = 1 then 

V Xn ■ ■■ V Xi V x ,p V x \V x \ ■ ■ ■ v^vi = ( * q 

and therefore 

ViV Xn ■ ■ ■ v X2 v xlPo v x \v x * 2 ■ ■ ■ v*x n _ x v;yi = Vi 

and so by taking the trace we get 

HV!V Xn ■ ■ ■ v X2 v xl pov;x 2 ■ ■ ■ C^Ji') 



* 




*Pn 
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*P12 




(59) = PllPlx n _ 1 Px n _ 1 x n _ 2 ■ ■ ■Px 3 x 2 Px 2 x 1 Px 1 x 1 

In a similar way, if x n = 2, 

v Xn ■ ■ ■ v X2 v xi Po v x \ v: 2 ■ ■ ■ v: n _x n = ( o I 

v 1 v Xn ■ ■ ■ v X2 v xl p v x \v x * 2 ■ ■ ■ v: n _XJi = y i ( o ° ) v i = ( 

and taking the trace gives 

HViV Xn ■ ■ ■ v X2 v xlPo v*x» ■ ■ • v: n -Xn v i) 

(60) = Pl2P2x n -iPx n -iX n -i ■ ■ ■ I >.,■■,.,-, I >.,-,.,- Pxix, 

Now we suppose x n +\ = 2, and we proceed in an analogous way. 

p(Xi = xi, . . . , X n = x n ,X n+ i = 2) 

(61) = tr(V 2 V Xn ■ ■ ■ V^poV^V:, ■ ■ ■ v: n _X n V*) 
By lemma [TJ we have two cases. If x n = 1 then 

v Xn --- V X2 V X1 p V x \ v x * 2 ■ ■ ■ vi^vi = ( o o ) 

therefore 

v 2 v Xn ■ ■ ■ v X2 v xl p v x \v x * 2 ■ ■ ■ Kn-iKW = v *(l o ) y; = ( 

and taking the trace we get 

tr(V 2 V Xn ■ ■ ■ V X2 V Xl p Q V:X ■ ■ ■ VL-XJZ) 

(62) = P2lPla n _ 1 Px n _ 1 x„_ 2 ' ' ' P.i P. IK, : ,, 

Analogously if x n = 2 

v Xn --- v X2 v xi Po v x \ v; 2 ■ ■ ■ vi^vi = ( o * ) 
v 2 v Xn ■ ■ ■ VxXpXX ■ ■ ■ K>-*K>v* = v * ( o I ) y2 * = ( T o 

and taking the trace 

tr(V 2 V Xn ■ ■ ■ VxXpoV^ ■ ■ ■ v^vzyt) 

(63) = P22 P2x n - 1 Px n -iX n - 2 ■ ■ ■Px 3 x 2 Px 2 x 1 Px 1 x 1 



*P21 





Corollary 1. The quantum stochastic process induced by 




is Markov. 
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Proof By the proposition, we have that the measure p reduces to the Markov 
measure for matrices. 

□ 

Lemma 2. For Vi linear maps and po fixed point for A = VipV* , we have for 
any m, n, 

p(Xi = xi,X 2 = X2, ■ ■ ■ ,X n = x n ) = p(X m = xi,X m+ i = x 2 , ... ,X m+n = x n ) 

Proof We prove the lemma for the case in which we have two possible states 1 
and 2. We have 

f^(X m X \ , X m ^i X2 , • ■ • , X rn J rn x n ) 

= ^(Xl = il, Xi = 12, • • • , -Xro-l = *m-l) X m = X\, . . . , X m + n = X n ) 

ii,...,i m -i 

= E tr{ y*« ■ ■ ■ v ^ v ^-i ■ ■ ■ V* VipoVfV? ■■■) 

i 2 ,---,i m -i 

+tr(V Xn ■ ■ ■ V Xl V lm _ x ■ ■ ■ V l2 V 2PQ V 2 *V* ■■■) 

= E t < v *n---v xl v im _ 1 ---v i2 p Q v*v*---v* m _ i v: i ---v: n ) 

t 3 ,...,» m _l 

Repeating the procedure above for i 2 , 13, etc. we get 

p(X m = xi,X rn+1 = x 2 , ■ ■ ■ , X m+n = x n ) = tr{V Xn ■ ■ ■ Vx-tpaV^ ■ ■ ■ V*J 
This concludes the proof. 

□ 

Example 10. Let us make an inspection with respect to the Chapman-Kolmogorov 
equation, that is, we would like to know if the equality 

(65) Hij(m + n) = p lk (m)fXkj (n) 

holds, where 

(Mj(n) = p(X m+n = j\X rn = i) 
Take for instance, m = n = i = j = l. Then 

Pik(m)p, kj (n) = p, n (l)p n (l) + ^12(1)^21(1) 

k 

, s _ tr(y 1 v lP v?v?y tr(v 2 v 1 pVfv;)tr{y 1 v 2P v;v?) 

[ ' tr{V lP V?) 2 tr(V lP V?) tr{V 2 pV 2 *) 

and 

p rj {m + n) =/in(2) = p(X 3 = 1\X 1 = 1) 

= tr^V^pV^V*) trjVMKpVfVJV*) 
[ ' tr{V iP V?) + tr{VxpVf) 

Now let Vi, V 2 be given by ([52]) . then we obtain classic calculations, so the Chapman- 
Kolmogorov equation holds. Now take 

«-(; !)■*-(; ° 
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then we get, from (|66|) and (|67"1) : 

1 ' tr{V iP V?Y tr{V xP V?) tr(V 2 pV 2 *) Pll + 4p 22 

and 

1 j tr(VipV?) + tr(*W) + 

Then in this case we have that the Chapman-Kolmogorov equation holds if and 
only if P22 = that is, if pu = 1. Also, we note that Yli ViVi 7^ I- To conclude 
this example, we take V\ and Vi with J2i V*Vi — I, namely, 

(7i) * iy v 2 = 

Take for instance po — \ | 1) (1 1 + 1 12) (2| , a fixed point for the associated A. A simple 
calculation shows that (|66|) and (|67|) are different. Therefore our calculation shows 
that the Chapman-Kolmogorov equation does not hold in general (for our setting) . 



We would like to obtain a nonhomogeneous version for the measure we defined in 
(|37p in the homogeneous case, i.e., we are looking for a measure induced by a nonho- 
mogeneous QIFS. Let Wi, i = 1, . . . , k be linear operators such that J2i W*Wi = I. 
Let po e Mn- Define 

p(Xi =xi,...,X n = x n ) := 

tr(W XlP0 W xl ) tr{ y xx()oV£i) tr(y Xa V XlP0 V £l V: a ) 

k HW^V^ ■ ■ ■ V^pgVZ ■ ■ ■ V^JV^J y 
HV Xn _ 2 ---V XlPo V* x ---V* n _ 2 ) 

tr{w Xr y Xn _ x . . . V Xl p V x \ ■ ■ ■ v^wzj 

tr(V Xn _ 1 ---V XlPo V* i ---V* n _ i ) 

p{Xi =xi,...,X n = x n ) := 

tr{W Xl V Xl _ x ■ ■ ■ V XlPo V x \ ■ ■ ■ V^Wl) 



(72) 
that is, 



(73) tr(W Xl p W* Xl )Yl 



i\ tr(V Xi _,V Xi _ 2 ■ ■ ■ V xlPo V x \ ■ ■ ■ V*_ 2 V*_J 



Remark A calculation shows that if we suppose J^i W*W{ = I, then 

2J fi(ii ■ ■ ■ i n ) = 1 

Besides, if we suppose that Wi = Vi for all i, then we recover the measure definition 
for homogeneous QSP. 
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Consider a QIFS F = {M.N>Fi,Pi}i=i,...,k, where 

F ( \ — V *P V * 
l[P> tr(V iP V*) 

where the Vi are linear and Pi{p) — tr(WipW*), com J2i W*Wi = I. 

Definition 18. We say that the pair ({X n } ne iq, p), X n : 51 — > {1, . , . ,k}, is a 
Quantum Stochastic Process associated to the nonhomogeneous QIFS F if 
\x is defined by where po G M n is any density operator. 

Remark In the definition above we can, of course, consider the particular case 
in which po is a fixed point for 

k 

A(p) = J2tr(W iP Wn Jif? 

tr(Vi P V*) 

induced by the QIFS T. 



Recall that by lemma [2j a homogeneous QSP is always stationary. This is no 
longer true in general for nonhomogeneous QSP. 

Example 11. Let {X n } n ^ be a QSP induced by a nonhomogeneous QIFS. We 
would like to know whether 

(74) »(X 1 = l,X 2 = 2)=p(X 2 = l,X 3 = 2) 
By definition we have: 

tr(W 9 VipnVi*Wn) 

(75) p( Xl = 1,X 2 = 2) = tr(W lP0 WZ) V(^*) 

And also 

p{X 2 = l,X 3 = 2) = M (Xj = l,X 2 = l,X 3 = 2)+p(X 1 = 2,X 2 = 1,X 3 = 2) 

triWxVipn V{ W{ )tr{W 2 Vi V l p V{ V x * W£ ) 



= tr(W lPo W?) 
(76) +tr(W 2PQ W 2 r ) 



tr{V lP oVr) triVMpoVfV?) 

triWiVzpoVtWDtriWzVMpoVjVfWZ) 
tr(V 2PQ V 2 *) triVMpoVJV?) 



tr 



W 2 Vi 



tr(W 1 p W 1 )—— — ^t(—7T7T7 — T7TT77- 
tr(VipaV*) V tr{ViVip V{V^) 



+ 



V^W 2 



(77) +tr(W 2 p Q W 2 )—— — — I — t7*T7*\ 

tr(V 2 p V 2 ) V tr(ViV 2 p V 2 *V{) J 

Note that in the homogeneous case we have that both fractions in parenthesis on 
equation (I77[) are equal to 1, so if po is a fixed point for A, then we have stationarity, 
a fact we have already proved. But in the nonhomogeneous case, the terms in 
parenthesis are not equal to 1 in general. 
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8. A DEFINITION OF ENTROPY FOR QIFS 

We will present a notion of entropy for "invariant" (or "stationary") measures 
with support on density matrices. This definition is obtained by adapting the 
reasoning described in [5], [12] and [13] to the present situation. The main idea is 
to define this concept via the Ruelle operator and to avoid the use of partitions. 

Denote by p an arbitrary choice of mappings pi : A4n K, i = 1, . . . , k for a 
certain k. Let 

rrib(MN) :={/:A^jv^K:fis measurable and bounded} 
Let Up : rn,b(Mjsr) -> m b (MN), 

k 

(U p f)(p) := J>(p)/(*!(p)) 

i=l 

Let us consider all possible choices of mappings pi : M. jy — > M which satisfy 
(78) Up 1 = 1 

Each p determines an operator U p . The set of all possible p that satisfy ([78]) will 
be denoted by P. 

Let (A4n, Fi,Pi)i=i....k be a QIFS. An example of Markov operator for measures 
is the one we defined before, given by V p : M 1 (Mn) — > M 1 (Mn), 

k 

(V p u)(B) = V / Pi du, 

which we will call the Markov operator Markov induced by the pi. That is, 
we will consider all V p with p € P. We say that v is invariant for the Fj if for 
some p € P we have that V p v = v. 

Let M.f be the set of all invariant measures for a fixed choice of the dynamics 
Fi, i = 1, . . . , k. For such measures v g A4f, and based on [5], [12] and [13], define 

k 



k0(l/) ^/S-,/ 10 ^^^ 



Above, IB + denotes the bounded, positive, borelean functions on A^jv. 
Proposition 4. For v E M.F, we have that < hoiy) < log A:. 
In order to prove this proposition, we need the following lemma. 

Lemma 3. [13j Let (3 > 1 + a and numbers a% € [1 + a, i = 1, . . . , k. The 

there exists e > 1 smc/i £/iai 

k k 
i=l i=l 

The proof of this lemma follows by choosing 

e = exp | 



/ + log 2^=i "A 

fc E a fc =i lo g a ^ ' 
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Lemma 4. If f e M + and v e Mf then 

k 



J2[foFidp> J fdv 



i=l 

Proof First suppose that f — 1b, where B is a measurable set. We have that 

k k k 

■ ' •''» 

/ 771 — 1 I T~>\ 

i—l ° i—1 ° i—1 



V / 1 B o F,dv > V / Pi(a;)lB(fi(a!))di/(a!) = V / Pi{x)dv{ 

= V p {v)(B)=v(B) = jl B dv 
Then, assume that / = Ylj=i bj^Bj, i.e., a simple function. Then 

E / E 6 ^ ° ^ = E 6 i E / ^ ° ^ 

i=l j=l j=l i=l 

^ E 6 i E / ftW 1 ^ (W)^ = E ww^i) 
j=i i=i j i=i 

= 5^6^-)= / /di/ 
J'=l 

Now let / = lim n f n , a limit of a sequence of simple functions. Note that we suppose 
/ £ B + , so / is bounded, and since v is a probability measure on A^w, it follows 
that / is integrable. By the bounded convergence theorem, we have that 

E / / ° F i di/ = E / lim /« ° = lim E / ^ n ° 

i—1 i—1 i—1 

> lim / f n dv = / lim/„di/ = / jdv 



□ 

The following proof is an adaptation of results seen in [13] . 

Proof of proposition [4] Let us restrict the proof for the case in which we have 
a QIFS (MN,Fi,pi)i=i t ... tk , where F^p) = V t pV* , with linear V % . 

First note that if / = 1, we have J log(J^. , l)dv — log fc, so h^iv) < log fc. 
Let I = f log (2j=i —p L )di> and suppose, without loss of generality, that 1+a < 
/ < /3 (note that this integral is invariant by the projective mapping / — > A/). Then 

k k 

(79) I = /log (E e -^~ i )dv = / log (E e/ ° F t )dv - / log (ef)du 
J i=l e -> J i=l J 

Define 

a i = f ° Fi(p) 

Then 

r\ f l l °sT,i=if oF i \ ^ 

e(p) = exp (t ,. — J > eo > 1, 
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by the compactness of Mn- With such choice we obtain, by lemma ((3]), 

k k 

(80) log(e ^/o^) >E lo g( £ o/°^) 

i=l i=l 

Apply ([80] ) on ([79 ]) . then 

k 

I>J2 f log(e /o Fi)dv- f log(e f)du 
i=i •* 

Then by lemma (@| applied on the function log (e/) (note that we have log (e f) £ 
B + because e > 1), we get 



I> J log(ef)du- J log(e/)^ = 

□ 

The computation in the next example shows that the concept of entropy de- 
scribed here is different from the one presented in [I] [2]- 

Example 12. We will consider an example of a probability -q such that V(ry) =77 
and we will compute the entropy of r\. 
Suppose a QIFS, such that 



V 



(p)=tr(W iP W*), 52w?Wi = I, Fi(p) 



tr(V lP V* 



for i — 1, . . . , k. Denote m^M n) the space of bounded and measurable functions 
in M ff. 

Consider A : Mn — >• Mn, 



Hp) = £>00*i(/0 = Y,tr(w iP w*) 



tr(V lP V*) 



Suppose there exists a density matrix P which A-invariant. As we know, such 
state is the barycenter of /1 which is V-invariant pQ. 
Suppose V/i = /i, then we can write 
k 



Z— 1 j 

= j2jtr(w iP wnf( VipVi 



Therefore, for any / £ rrib(MN), we got the condition 



HV lP V*) 

dfi 



(81) Jf^ = ^Jtr(W iP W:)f(^^)dp 

Let us consider a particular example where N — 2, fc = 4, and 



/' 



«-l " °), H = /0 



P21 J V ^/pii 
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in such way that the pij are the entries of a column stochastic matrix P. Let 
7r = (tti, 7r 2 ) be a vector such that Pn = n. A simple calculation shows that for p, 
the density matrix such that has entries p^ , we have 



(82) 
(83) 

and therefore 
(84) 



V lP V 1 * = 
V 3P V* = 

VipV{ 
tr{V lP V? 

tr(V 3 pV£ 



PnPn 




P21P11 



v 2P v 2 * = 

v 4P v: = 
V2PV2 

tr(V 2P V 2 * 

^ ^ " 1 " 1 ' ' ir(F 4 pF 4 * 

that is, the above values do not depend on p. 
Define 

(86) = 
and 

(87) n = m5 P 

Note that the barycenter of rj is 

Pq = T^lPx + TT 2 Py = 7Tl 



1 





1 



1 




P12P22 




P22P22 



1 





1 



1 



Pv = 



■ 7T 2 (5„ 



■ 7T2 




1 







J V 1 

One can show directly that V(r)) = rj (see [I]). Define 



7Ti 
7T 2 











( 






v 


) 

J 


) P2 = 1 


v 





and also 

(89) 7) = 7Ti6 pl + ir 2 5 P2 

Note that the barycenter of 77 is 



Pr, = TTlPl + 7T2/92 = 7Tl 



1 





+ 7T 2 




1 



7T1 
7T 2 



From this it will also follow that V?y = 77 [T] . We will show that the entropy of such 
■q is log(2) — tti log(7Ti) — 7r 2 log(7r 2 ). Remember that 

/i 0g (E^)^ 



(90) = 



/io g (E/(^y))^-E/M^)io g /( 
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For such choice of Vi take 



< 91 > C ' = / (W))- '- 1 -- 4 

Note that 



(92) ci = c 2 , c 3 = c 4 
Then we can write 

(93) / log ( ^ dr, = f log ( ^) d V -J2 [ HW lP W*) log c^. 
Therefore 

/ log ( ^2 ^~p~) dri = 7ri log ( 51 Ci ) + ^ log ( Ct ) 

- [tr{ViPiV?)m log (a) + tr(V iP2 V*)K2 log (<*)] 

i 

= TTi log (2ci + 2c 3 ) + tt 2 log (2 Cl + 2c 3 ) 

- [tr(V iPl V*)m log (ci) + tr(V iP2 V*)n2 log (<*)" 

= log (2(ci + cs)) - J] [M^PiW>i log (Ci) + tr(V5p2V;*)7r2 log (c.) 

= log (2(ci +c 3 )) 

- TTi^p^ log(ci) +P12P21 log(c 2 ) +P21P11 l0g(c 3 ) +P22P21 l0g(c 4 )) 
+7T2 (pilPl2 l0g(ci) + P12P22 l0g(c 2 ) + P21P12 l0g(c 3 ) + P22 l°g( c 4)) 

= log (2(ci + c 3 )) 

- Plll0g(Cl)(7TlPn +7T 2 pi 2 ) +Pl 2 log(c 2 )(7Tlp 2 l + 7T 2 p 22 ) 
+P21 l0g(c 3 )(7TlPll + 7T 2 pi 2 ) + P22 log(c 4 )(7Tlp 2 l + 7T 2 p 22 ) 

= Iog(2(ci+C3)) 
- 7TlPn l0g(Cl) + TT 2 Pl2 log(c 2 ) + 7Tlp 2 l log(c 3 ) + 7T 2 J3 22 log(c 4 ) 

= log (2(ci + c 3 )) - (tti log(ci) + tt 2 log(c 3 )) 

Finally, 

(94) J log(^^A)rfr;-log(2(c 1 +c 3 ))-(7r 1 log(c 1 ) + ^ 2 log(c 3 )). 

Now we will use Lagrange multipliers. Define b : R+ — > R, where R+ is the 
of positive coordinates, by 

6(a;, y) = log (2(x + y)) - (m log(x) + tt 2 log(y)) 
We impose the restriction 

x + y = a 
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for fixed a > 0. We will get bellow the critical point of b under such restriction. 
After that we consider a general a > 0. 
Define 

g(x,y) =x + y-a 



and 



r(x,2/,A) =b + Xg 



Then, Vr = implies 

(95) — — + A = 

x + y x 

(96) — — + A = 

x + y y 

(97) x + y = a 
from which follows 

(98) x = iTia, y = n 2 a. 
Therefore, 

(99) C\ — C2 = 7Tlffl, C3 = C4 = 7T 2 a 

From (|94p we get 

f°Fi 



/ 



d?7 = log (2(7Tia + 7r 2 a)) — (7ri log(7Tia) + 7r 2 log(7r 2 a)) 



= log(2a) - 7ri log(TTia) - tt 2 log(7r 2 a) 
= log(2) + log(a) - 7ri log(TTi) - 7ri log(a) - 7r 2 log(7r 2 ) - tt 2 log(a) 

(100) = l0g(2) - TTl log(iri) - 7T 2 log(7r 2 ) 

This value of entropy is different from the value computed in the same example 
of QIFS in [I], [2] which is — J2 i - itiPji logpji (Example 7 in section 11 PQ). 



Given the expression 

A- 



i=l 

for a fixed probability is, which is invariant by the shift acting on the space f2, a 
natural question is to identify the / which realizes the infimum above. 

We will describe below the analysis of the classical case (in the sense of Stochastic 
Processes, and not QSP). Our purpose is to explain why the definition presented 
above is a natural generalization of the setting for Markov Processes. In the case 
the probability v comes from a Markov Process this will be now derived. 

Let f2 = 7^, where I m = {l,...,m}, and let C = {C L : i € U n£ N-^} the 
collection of cylinder sets in J7, where 

C L := {u E l(! : w(j) = = l ) ...,r,L= (ii, . . . ,i r ) £ I r m ] 
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and denote by cr(C) the cr-algebra generated by the cylinders in fi. 

Let (P,tt) be a Markov chain, so that P — (pij) is a matrix of order n, with 
Pij > 0, ^2jPij = 1 (row stochastic), and n = (in,... ,ir n ) is the left eigenvector 
with eigenvalue 1. So irP = n, that is, J2 i KiPij — nj. 

Associated to the matrix P we have the following measure. 

Definition 19. The Markov measure (associated to the chain (P,tt)) of a cylin- 
der is defined as 

(101) V{C,) := TT^Pi^Pi^ ■ ■ -p ir _ lir 



We are interested in the following problem: find the infimum / in 

(102) ho(v) := inf f log(£ ^)du 

' J i=i ■* 

for such v defined above. 



We use the notation ij to denote the cylinder set in 7^ which consists of the set 
of sequences (wi,W2, • • • ) such that w\ ~ i and W2 = j. Denote by ljj the indicator 
function of ij. To simplify, suppose m = 2 so the alphabet considered contains only 
two symbols, denoted by 1 and 2. Define the following function / : 7^ K + , 

2 

(103) f{x) = 

where a,j € R + . That is, / is a simple function, constant on ij. In this form, 
lo g/ = EijlogOtfly- 

Let us suppose that Ft : 7^ — > 7^ is the mapping Fi(wi,W2, . . .) — (i, w\,W2, ■ ■ ■)■ 
If is a Markov measure, we have 
(104) 

r r 2 2 2 

l\ogfdv= I lo g( a u)V = X! lo s( a yM*j) = X! '•"•-"<.< 

J 2 Jl 2i,j=l i,j = l i,j = l 

Also, we have for w = (i,j,...), 

(105) / o Fi(w) = ^ a^%(FiH) = a,, 

To see that, note that by the expression above we have a sum of terms such that 
(i,j) = therefore Ojj = aj». 



Then 



2 2 
/ log(^^r^)^= f l0g(£ foF t )dv- f log fdv 
J i=l ■' J 1=1 J 
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(106) = / log(^ / o Fi)dv - ^2 KiPijlogdij 

■> i=i ij=i 

Note that for any !«£j',B)=(l,...)ori(i = (2,...). Then, by (I105[) we get 

(107) V/oF,M = ( ° 11+a21 sew = ^---\ 
V ; ^-f V ^ I ai2 + a 22 sew = (2,...) 

Now fix a,ij — pji, where pij are the entries of the row stochastic matrix P 
initially fixed. Then we get an + a 2 i = pn + P12 = 1 e a i2 + a 2 2 = P21 + P22 = 1- 
Therefore for such choice of and for any w £ 1^, the sum (|107|) equals 1. So, 
by (finni), we get 

(108) / log(^ ^y 1 )^ = - E ^ lo §^ = 

i=l i,j=l 

Therefore, 

2 

(109) ^nf + | log(£ ^)dv < H{P) 



Now note that any positive function / can be written as 

2 

f{w)= dijPji lj-(w) 



Define 



and 



We have 



u(w) := a ij %H 

2 



f f 2 2 - 

/ log fdv= / V log (a^i) l^i/ = V log (aijPji)v(ji) 

2 2 2 

(HO) = X "J^* lo s( a «^i) = X 7r jft» 1 °sKj)+ X ^jPit log(pji) 

*ii=i «ii=i *ii=i 

If w; = («, j, . . .), then / o Fi(w) = aupu and so 

1 1 

We write 

(111) C g (u)(w) =J2f°FiH =EEw 1 ii( f 'H 

We also have the following: 
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Lemma 5. 



And also 



□ 



(112) J £ g (logu)d^ = J logudu 
Proof We have 

(113) J logudu = J ^2^og(aij)ljidu = ^ log(a y )v(jl) = ^ log^ !-,/>,, 

i,j i,j i,j 

J C B {\ogu)dv = J ^^log(a lJ )p Jl lij(i ; i(w))^ 

(114) 

i,j I i,j i,j 

So, 

(115) J C g {\ogu)di> — J logudu 
Then, by using (|TTU)) . (HH and ([IB]) , 

k 2 

[ log(J2^^)du= f log(J2foF l )dp- f log fdv 
i=i J J i=i J 

. 2 2 2 

= / log(^/oF ; )d^- ( ^ log(ay) + Y n iPij lo &(Pi. 

(116) = J \og{C g {u))dv- Jlogudu + H(P) 

(117) = f log (C g (u))dv- J C g {\ogu)dv + H{P) 
We would like to show that 

(118) J log{C g (u))dv- J C g (logu) dv > 

This follows immediately if we show that for w = 

(119) log(C g (u))(w) >£ fl (log u)(w) 

The last expression follows from convexity. Indeed, to prove the above inequality, 
it is enough to show that for any w = ■ . ■ ), we have 

(120) log ( Y a UPil ) > Y Ptl log au 

i i 

And such inequality is true, because the pu are positive numbers with Y],pu = 1, 
for any i, and the function log is concave. 
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Therefore we conclude from (|117p and (|118j) that 

k 

(121) f Yog(£ f -^)dv>H{P) 

J z=l ^ 

Conclusion By (|109[) and (II 2 1 1) we conclude that if v is a Markov measure 
associated to a stochastic matrix P, then 

2 

(122) Mjlo g C£^)d„ = H(P), 
and the function / such that 

2 

(123) f(x) = PiAijW 
realizes the infimum. 



We conclude this section by stating the variational problem of pressure for our 
setting. We consider the the set of Vi, i = 1,2,..., A; fixed, and we consider a 
variable set of Wi, i = 1, 2, . . . , k. In the normalized case, the different possible 
choices of pi, i = 1,2,..., k, (which means different choices of Wi, i = 1,2, ... ,k) 
play here the role of the different Jacobians of possible invariant probabilities (see 
[15] II. 1, and |12| ) in Thermodynamic Formalism. In some sense the probabilities 
p can be identified with the Jacobians (this is true at least for Gibbs probabilities 
of Holder potentials [T7]). The set of Gibbs probabilities for Holder potentials is 
dense in the set of invariant probabilities [llj . 

Let H : M.m — > A4n be a hermitian operator. We have the following problem. 
Define F :M f ^M, 

k 

F (p) := h (n) - -tr(H Pfl ) = inf / log(^ -?—^)dp - -tr(H Ptl ), 

where p^ is the barycenter of p, that is, the unique p € A4 jy such that 

l(p) = I Idp, 

J M N 

for all I £ V* . Then, in order to find the associated Gibbs state we have to find 
p € M.f such that 

F (p) = sup F (/i). 
We consider above each p which is associated to a possible set of Wi . 
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